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Summary 


A blackboard system consists of a set of knowledge sources, a blackboard data structure, and a 
control strategy used to activate the knowledge sources. The blackboard model of problem- 
solving is best described by Dr. H. Penny Nii of the Stanford University AI Laboratory: 

“A Blackboard System can be viewed as a collection of intelligent agents who are 
gathered around a blackboard, looking at pieces of information written on it, thinking about 
the current state of the solution, and writing their conclusions on the blackboard as they 
generate them.” 1 

The blackboard is a centralized global data structure, often partitioned in a hierarchical manner, 
used to represent the problem domain. The blackboard is also used to allow inter-knowledge 
source communication and acts as a shared memory visible to all of the knowledge sources. A 
knowledge source is a highly specialized, highly independent process that takes inputs from the 
blackboard data structure, performs a computation, and places the results of the computation in the 
blackboard data structure. 

This design allows for an opportunistic control strategy. The opportunistic problem-solving 
technique allows a knowledge source to contribute towards the solution of the current problem 
without knowing which of the other knowledge sources will use the information. The use of 
opportunistic problem-solving allows the data transfers on the blackboard to determine which 
processes are active at a given time. 

Designing and developing blackboard systems is a difficult process. The designer is trying to 
balance several conflicting goals and achieve a high degree of concurrent knowledge source 
execution while maintaining both knowledge and semantic consistency on the blackboard. 
Blackboard systems have not attained their apparent potential because there are no established tools 
or methods to guide in their construction or analyze their performance. 

The lack of a coherent set of design tools and guidelines has resulted in blackboard systems 
being developed in an ad hoc fashion. Designers have been forced to make design choices in a 
void, in many cases leaving the designer stuck with a poorly designed system because revisions 
are too difficult once the system has been implemented. This lack of design and analysis tools is 
one of the reasons why incorporating concurrency into the blackboard problem-solving model has 
not been successful. The use of a centralized control mechanism and contention in accessing the 
blackboard have also restricted the success of previous systems. 

A set of blackboard system design tools that can be used to test and refine a proposed 
blackboard system design before the design is implemented has been developed and validated . 

The set of blackboard system design tools consists of a Knowledge Source Organizer, a 
Knowledge Source Input/Output Connectivity Analyzer, and a validated Blackboard System 
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Simulation Model. This paper presents the structure and functionality of the Knowledge Source 
Input/Output Connectivity Analyzer. An example outlining the use of the Knowledge Source 
Input/Output Connectivity Analyzer to aid in the design of a concurrent tactical decision generator 
for air-to-air combat is presented. The blackboard system design and analysis tools are designed 
for generic blackboard systems and are application independent. 

Introduction 


Blackboard systems are a natural progression of expert systems into a more powerful problem- 
solving technique. They provide a way for several highly specialized knowledge sources to 
cooperate to solve larger and more complex problems. Blackboard systems incorporate the 
concepts developed by rule -based and expert systems programmers and include the ability to add 
conventionally coded software to cooperate in solving problems. The specialized knowledge 
sources are easier to develop and test and can be hosted on hardware specifically suited to the 
problem that they are solving. The use of opportunistic problem-solving, the data-driven control 
structure, and highly specialized knowledge sources allows a set of knowledge sources to 
cooperate to solve large, complex problems. 

Designing and developing blackboard systems is a difficult process. The designer is trying to 
balance several conflicting goals: achieving a high degree of knowledge source parallelism, and 
maintaining memory and semantic consistency. Several major problems facing the designers of 
blackboard systems have been outlined in the current literature, k-,4 

1) Speculative parallelism can be very costly and adversely affect system performance. 

2) Memory management and memory coherence can become difficult and time consuming. 

3) Process locking and concurrency control overhead can adversely affect opportunistic 
problem-solving. 

4) Real-time systems require predictable response times. 

5) Overly restrictive concurrency control can restrict the parallel execution of knowledge 
sources. 

6) Dynamically allocating and deallocating knowledge sources to achieve good processor 
utilization and load balancing can be time consuming, and the overhead required may 
outweigh the gains of parallel execution if the knowledge sources are small or execute 
swiftly 

Blackboard systems have not attained their apparent potential because there are no established 
tools or methods to guide in their construction and analyze their performance. Daniel Corkill 
states: 


“At present (1989), intuition is the primary criterion for making an appropriate set of 
design choices. Application characteristics, hardware and communication characteristics, 
and how the application is implemented are all likely to strongly affect the performance of a 
parallel or distributed blackboard application. 

What is needed are system engineering guidelines for making appropriate design 
choices and improved languages and tools for constructing parallel and distributed 
blackboard applications. Such engineering guidelines require empirical measurements of 
pioneering applications. A few data points are beginning to emerge, but direct 
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measurement of applications designed and executed on real parallel or distributed hardware 

remains to be performed.” 2 

Unified Approach to System Design and Analysis 

A blackboard system designer requires a coherent set of blackboard system design, simulation, 
and analysis tools to be able to build systems that realize the full potential of the blackboard 
problem-solving model. A system implemented using a set of highly specialized, highly 
independent knowledge sources with a data transfer driven control mechanism will be faster, more 
efficient, and more powerful than current systems. This type of blackboard system does not 
require the centralized blackboard controller. Centralized control modules have been shown to be 
one of the major bottlenecks in existing concurrent blackboard systems. 1 ’ -’ 4 

To achieve these design requirements, a set of design and analysis techniques for blackboard 
systems has been developed. The set of design aids consists of a Knowledge Source Organizer 
and a Knowledge Source Input / Output Connectivity Analyzer. A validated Blackboard System 
Simulation Model and a set of blackboard evaluation metrics have been developed to analyze the 
performance of blackboard systems. 

A set of automated Blackboard System Design and Analysis Tools is being developed to 
support the design and analysis of concurrent blackboard systems. The first section of the design 
and analysis tool aids the designer in decomposing the problem domain into a set of knowledge 
sources and outlines the input/output pairs for each knowledge source. An outline of the structure 
of the blackboard data objects is also developed at this time. 

The second section of the tool uses the input/output pairs for the initial knowledge source 
partitioning to create a data connectivity graph of the system. The data connectivity graph is then 
used to measure knowledge source independence, data transfers across the blackboard, and 
commonly shared data objects. A simplified data connectivity graph is shown in figure 1. 

The knowledge source I/O connectivity analysis system then searches for tightly coupled 
knowledge sources (using a heuristic to measure coupling) and highlights those knowledge 
sources by directly connecting the knowledge sources and marking the link with a star (figure 2). 
The knowledge sources can then be restructured to increase the independence of the knowledge 
sources. This process can be repeated until the system design constraints are met, or until the 
knowledge source coupling metric is minimized 

Preliminary Research 

Preliminary research 3 - 6 has shown that efficient implementation of blackboard systems 
requires that the knowledge sources be highly specialized and highly independent. A knowledge 
source is considered to be specialized if it is designed to solve a specific task or subtask. A 
knowledge source is considered independent if it requires data from the blackboard for execution, 
not from a specific knowledge source. 
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Figure 1. Initial Knowledge Source Connectivity Graph. 



Figure 2. Updated Knowledge Source Connectivity Graph. 

Knowledge source specialization provides the following benefits: 
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• Improves performance of rule -based and expert systems. Specialization results in smaller 
rule bases and allows for the use of meta-knowledge and meta-rules to guide rule-partition 
selection, which results in fewer rules being active and faster system performance . 2 

• Provides for smaller knowledge sources that solve specific problems. The smaller, 
specialized knowledge sources are easier to develop and test since each knowledge source 
solves a small part of the total problem. 

• Leads to systems that can cooperate in parallel on large problems. 

• Reduces input and output overlap. 

• Reduces write set conflicts and concurrency control requirements. 

• Reduces the chance of semantic synchronization being violated because it reduces the 
chance of one knowledge source’s output invalidating the output of another knowledge 
source. 

• Reduces memory contention at the blackboard level. 

Knowledge source independence provides the following benefits: 

• Centralizes problem-solving functionality, making the function of each knowledge source 
easier to understand and provides for modular protection. 

• Increases opportunistic execution of knowledge sources. 

• Reduces the input/output connectivity between the knowledge sources. 

• Reduces inter-knowledge source data transfers across the blackboard. 

• Reduces data traffic on the communications medium. 

• Reduces concurrency control requirements. 

• Reduces blocking of knowledge sources. 

• Reduces memory contention on the blackboard. 

Knowledge Source I/O Connectivity Analysis 

A static knowledge source Input/Output connectivity analysis of the preliminary design of a 
blackboard system’s knowledge sources and blackboard structure is used to determine the data 
transfers between the knowledge sources, data migration across the blackboard, and knowledge 
source independence. Knowledge source I/O connectivity analysis measures the “connectivity” 
between knowledge sources and the overlap in the knowledge source output sets. The I/O 
connectivity is a measure of the independence of knowledge sources, and the output set overlap is 
a measure of the specialization of knowledge sources. Knowledge source pairs with a high level 
of I/O connectivity are highly dependent on each other, pairs with a low level of I/O connectivity 
are independent of each other. Knowledge source pairs with a high level of output set overlap 
compute similar functions and are not specialized. Knowledge source pairs with a low level of 
output set overlap are highly specialized. Knowledge source independence and specialization 
values are used to refine the design of blackboard systems. 
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To perform the static knowledge source input/output connectivity analysis for a blackboard 
system we treat the blackboard system (3 as a set of knowledge sources. 

P = {ksi,ks 2 ,...,ksj} (0) 

For each knowledge source ksj in p we can form a set containing all of the input variables of 
ksj; and an output set <t>j containing all of the output variables of ksj. v Pj consists of both the 
blackboard inputs and the external inputs. If ksj is a sensor, v l'j may contain only external inputs. 
Note that for any knowledge source ksj if <t>j = o the design is invalid since the knowledge source 
does not update the blackboard. 

Tj = { iv i , iv 2 , iv n } (1) 

<t>j = {OVI, ov 2 , ..., ov m } (2) 

Once Tj and <t>j have been formed for all ksj in p we can compute the sets ryk and Qj,i< for all 
knowledge source pairs j kspksk } in p (j ^k). 

Fj.k = <*>j n <t>k (3) 

©j k = <t>j n (4) 

The cardinality of the set Tj k for each pair {ksj,ksk} in p is a measure of output overlap for the 
pair {ksj,ksk}. Knowledge source pairs, {ksj,ksk}, with a large output overlap imply that ksj and 
ksk share a large number of output variables and perform similar functions. Knowledge source 
pairs, {ksj,ksk}, with a low overlap imply that ksj and ksk perform different functions. A 
proposed "heuristic to measure knowledge source independence is to compute an independence 
value, £2j,kfor each pair {kspksk} in p. 



card(I j.k^ 


min(card(cf>j ) card (<£>]/)) 


(5) 


This heuristic was developed to compute the percentage of overlap between the sets <t>j and <t>k- 
The cardinality of the set Tj k divided by the minimum of the cardinalities of the sets <t>j and <I>k 
computes a percentage of overlap between the set rj k and the smaller of the sets <t>j and <t>k- As 
£2j,k approaches 1.0 the output overlap between ksj and ksk increases, as ftj,k approaches 0.0 the 
output overlap between ksj and ksk decreases. For the limiting cases, if <t>j 3 <t>i< or <E>k 3 <T>i, we 
know that Hjk = 1.0, and ksj and ksk compute the same outputs and are not specialized. Ir rj k = 
<>. we know that Hj k = 0.0, and the two knowledge sources have no common outputs and are 
highly specialized. 


The cardinality of the set 0j k for each pair { ksj ,ksk } in p is a measure the input/output 
connectivity for the pair {ksj,ksk}. Knowledge source pairs {ksj,ksk} with a high connectivity 
imply that ksk is highly dependent on ksj for its input variables, conversely knowledge source 
pairs {ksj,ksk} with a low connectivity imply that ksk's inputs are independent of ksj's outputs. A 
proposed heuristic to measure knowledge source connectivity is to compute a connectivity value, 
rij,k for each pair {kspksk} in p. 


n j,k 


card0jk 

min (card(<t>iJ. cardt 1 !^)) 


( 6 ) 
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This heuristic was developed to compute the percentage of overlap between the sets <t>j and 'IV 
The cardinality of the set ©j |< divided by the minimum of the cardinalities of the sets <t>j and 'V 
computes a percentage of overlap between the set 0jj< and the smaller of the sets <t>j and 'IV As 
riyk approaches 1.0 the I/O connectivity between ksj and ksi< increases (figure 1), and as rijjj 
approaches 0.0 the I/O connectivity between ksj and ksi< decreases (figure 2). For the limiting 
cases, if 4>j 3 'Pk or 'Pk 3 <t>j, nyk = 1.0 and ksj and ksk have direct I/O connectivity. If ©yk = <>, 
nj,k = 0.0 and the two knowledge sources have no 1/(3 connectivity. 

Discussion of Results 


The results of the static input/output connectivity analysis can be used to measure the 
specialization and interdependence of the knowledge source in (3. The static knowledge source I/O 
connectivity analysis will produce a measure of the interdependence between knowledge sources 
and a measure of the data transfers across the blackboard and through the network. From this 
analysis the designer can determine if the knowledge sources have been partitioned correctly and if 
the expected level of knowledge source independence has been achieved. This type of analysis has 
been done by hand while developing several blackboard systems. 3 - 6 

These preliminary heuristics were developed during the design and testing of the 
Cube_CLAWS blackboard system 4 . The initial design stressed knowledge source specialization 
and did not consider knowledge source independence. During system testing inefficiencies in the 
initial design of three knowledge sources were discovered. The following example will show the 
original knowledge source designs and the knowledge sources I/O connectivity and independence 
values. The system was then redesigned to achieve better knowledge source independence. 

Initial system design: 


P = {ksi, ks 2 , ks 3 } 

'Pi = 7, <t>i = 2 
= 9, <t>2 = 4 
*P3 = 4, <I>3 = 6 


Ft, 2 = 9 

F2,l = 9 

r 3,l = 9 

©1,2 = <l> 

©2,1 = 4 

@3,1 = 9 

Fl,3 = <l> 

F2,3 = 9 

F3,2 = 9 

©1,3 = 9 

©2,3 = 4 

©3,2 = <> 

T2 1 2 = 0-0 

(22 1 = 0.0 

(2 3 j = 0.0 

ni’,2 = 0.0 

n 2 ’i = TO 

n 3 ’i = 0.0 

T2 1 3 = 0.0 

(22,3 = 0.0 

(23,2 = 0.0 

ni’,3 = 0.0 

Il2,3 = 1.0 

n 3 ’ 2 = 0.0 


Analyzing the initial design shows that ksi and ks 2 , and ks 2 and ks 3 both have I/O connectivity 
values of 1.0. This high degree of I/O connectivity caused very short processing pipelines to occur 
and forced serial execution of these knowledge sources. The small size and fast execution rates of 
the knowledge sources made pipeline processing a costly approach. The cost of message passing 
was greater than the speedup gained by parallel execution of multiple copies of the knowledge 
sources. The system was redesigned to decrease I/O connectivity. The redesigned system 
combined the second and third knowledge source into a single knowledge source. 

For the redesigned system: 
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p = {ksi, ks2} 


'Pi = 7,<t>i =2 
^2 = 10 , < t >2 = 9 


ri,2 = 4» r2,i = <> 

© 1,2 = <|> © 2,1 = 4 

£2 ] 5 2 = 0.0 122,1 = 0.0 
ni,2 = 0.0 112,1 = 0.57 

The redesigned system provided better performance than the first system with little loss in 
knowledge source specialization. This research clearly shows that the design process must 
consider both knowledge source specialization and knowledge source connectivity and find a 
balance between the two that will provide optimal performance. 

Concluding Remarks 


A concurrent object-oriented blackboard system that is faster, more efficient, and more 
powerful than existing systems can be developed using the design, simulation, and analysis tools. 
The use of the design and analysis tools provided the highly specialized, highly independent 
knowledge sources required for concurrent blackboard systems to achieve their design goals. The 
knowledge source connectivity analysis highlights potential memory hotspots and system 
bottlenecks, and identifies knowledge sources where the message-passing costs and other 
knowledge source communication costs outweigh the gains made by concurrent knowledge source 
execution. The system can also be used to predict the amount of time each knowledge source 
should require to read/write the blackboard objects, and where potential memory access conflicts 
can occur between knowledge sources. 

The blackboard system designer can use the results of the knowledge source connectivity 
analysis to revise the blackboard system design. The design can be modified to gain the desired 
knowledge source size and independence, and the desired knowledge source I/O connectivity. 
These blackboard system design and analysis tools are designed to function for generic blackboard 
systems and are application independent. 
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